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As  a |>ai  < i the  Great  lakes  Shoreline  Damage  Survey  for  the  U.S. 
Army  Corps  o»  h Lr.eers , data  was  collected  by  means  of  Uo  x.rvey  tools 
a mailed  sel’  . 01  i n i stered  assessment  and  personal  interviews.  I r. 
formation  col  i.e<  ! d included  shoreiand  homeowners'  perception?  of  (1) 
physical  property  measurements  and  (2)  monetary  values  oi  (a)  property 
worth  and  <b)  o vuage  incurred  due  to  flooding  and  erosion.  In  order 
to  assess  n-.w  u urately  the  property  owner  could  estimate  physical 
and  finania;  n.rameters,  independent  measurements  were  made  to 
compare  wf'li  tuv  results  provided  by  respondents. 


Data  was  collected  in  the  following  categories:  present  prop- 

erty worth,  biuff  height,  and  the  distance  from  the  bluff  edge  to 
the  foundation  of  the  house.  These  parameters  were  chosen  because 
they  typify  homeowners  perceptions  of  monetary  value,  vertical  dis- 
tance, and  horizontal  distance,  respectively. 

The  present  property  worth  was  evaluated  by  a local  realtor, 
who  was  only  able  to  make  his  assessment  of  the  property  value  by 
looking  at  the  exterior  of  the  home  and  the  grounds.  It  is  not  known 
how  much  the  estimations  made  by  the  realtor  are  affected  by  not 
viewing  the  interior,  although  it  is  felt  that  these  appraisals 
are  reasonably  accurate. 

Both  vertical  and  horizontal  distances  were  measured  at  the 
site.  Vertical  distance  was  not  measured  directly,  but  was  cal- 
culated from  the  distance  measured  from  the  bluff  edge  to  the  beach 
and  the  slope  of  the  bluff  face. 

The  data  was  compiled  for  each  county  and  paired  with  the 
corresponding  respondent  to  the  self-administered  assessment,  and 
separately  paired  with  the  appropriate  personal  interview. 

Each  paired  set  of  data  was  then  analyzed  statistically  using 
two  different  methods.  The  first  method  is  a pairwise  t-test,  where 
the  null  hypothesis  is  that  the  mean  difference  between  the  two  sets 
.of  data  Is  zero.  If  this  was  true.  It  would  mean  that  the  information 
provided  by  the  respondent  was  statistically  equivalent  to  the  mea- 
sured values,  and  therefore  could  be  used  as  accurate  information. 

The  requirement  for  the  use  of  this  test  Is  that  the  differences 
have  a normal  distribution.  Since  the  data  sets  were  not  necessarily 
normally  distributed,  a second  method  of  testing  was  used.  This  was 
the  Wllcoxon  rank-sum  test  for  matched  pairs,  and  is  the  non-para- 
metrlc  equivalent  of  the  first  test.  Instead  of  using  mean  differ- 
ences, this  method  tests  the  hypothesis  thst  the  median  difference 
is  zero.  It  does  not  require  that  the  differences  be  normally  dis- 
tributed, but  is  not  ss  powerful  a test.  Consideration  should  also 
he  given  to  the  effect  of  sample  size  on  the  power  of  this  test. 

The  smaller  the  sample  size,  the  leas  powerful  the  teat,  as  there  is 
more  room  for  error. 
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To  interpret  these  tests,  the  use  of  the  significance  level  is 
employed.  The  significance  level  is  generally  interpreted  as  the  . 
probability  of  rejecting  the  null  hypothesis  when  the  null  hypothe- 
sis is  true.  In  the  context  of  this  report,  if  we  hypothesize  that  the 
mean  difference  of  the  reported  values  and  the  measured  values  is 
zero  (null  hypothesis),  the  significance  level  will  indicate  what 
the  probability  is  of  being  wrong  if  the  hypothesis  is  rejected. 

For  a suitable  criterion,  the  controlling  significance  level  of  .10 
has  been  chosen.  For  significance  levels  of  less  than  .10  there 
is  less  than  a ten  percent  probability  that  a rejection  of  the  null 
hypothesis  is  in  error.  If  the  level  of  significance  is  greater  than 
.10,  then  the  null  hypothesis  is  not  rejected.  In  such  instances, 
support  is  given  to  the  hypothesis  that  values  given  by  the  respondents 
do  not  differ  significantly  from  the  measured  values. 

The  measured  data  were  compared  to  the  corresponding  self-admin- 
istered assessment  data  and  the  data  from  the  personal  interviews  using 
both  of  the  above  tests.  Tables  J-I  and  J-II  show  the  relative 
values  for  the  parameters  used  in  analysis  in  Muskegon  and  Malnstee  Counties. 
It  should  be  noted  that  the  mean  of  independent  measurement  values  for 
the  same  variable  may  differ  in  the  table.  This  difference  is  due  to 
the  size  of  the  randomly  generated  sample.  For  example,  in  Table 
J-II  of  the  mean  bluff  to  foundation  distance  is  70.3  which  was  obtained 
by  using  independent  measurements  for  a random  sample  of  23.  The  mean 
for  the  same  variable  is  59.7  using  an  independent  measurement  for  a 
random  sample  of  13.  The  statistical  tests  described  above  "adjust" 
for  differences  in  mean  values  based  on  sample  size.  Tables  J-III  and 
J-IV  Indicate  the  results  of  the  statistical  analysis  performed 
on  each  paired  set.  The  following  paragraphs  contain  the  results 
of  these  tests  for  both  Muskegon  and  Manistee  Counties. 


Muskegon  County 

Property  worth — The  independent  measurements  were  first  compared 
to  the  equivalent  responses  from  the  self-administered  assessment.  Using 
the  t-test,  with  a sample  size  of  22,  there  appeared  to  be  no  difference 
between  the  two  data  sets,  with  a significance  level  of  approximately 
.60.  A check  of  the  distribution  of  the  differences  indicates  a 
reasonably  normal  curve.  The  non-parametric  method  yielded  a 
significance  level  of  .115,  still  greater  than  .10. 

In  comparison  to  the  data  from  the  personal  interviews,  for  a 
sample  size  of  30,  significance  levels  were  again  high.  Both  the 
parametric  and  non-parametric  test  indicated  that  the  information 
supplied  by  the  respondents  was  not  significantly  different  than  the 
Independently  measured  value  of  property  worth. 

Bluff  height — The  significance  levels  for  the  tests  on  bluff 
height  data  show  that  the  two  t-tests  indicated  a rejection  of  the 
null  hypothesis  and  therefore  a difference  in  the  means,  while  the 
non-parametric  tests  indicated  no  significant  difference.  Looking 


at  the  histograms  of  the  differences,  it  was  found  that  no  normal 
distribution  occurred,  thus  invalidating  the  t-tests.  Therefore,  the 
evidence  suggests  the  mean  values  are  statistically  not  different. 

Bluff  to  foundation  distance — Both  tests  for  the  self-admin- 
istere3  assessment  data  comparison  show  significance  levels  above 
.10,  including  no  significant  difference  between  these  responses  and 
the  measured  data.  In  both  tests  of  the  personal  interviews,  though, 
rejection  of  the  null  hypothesis  is  indicated,  and  therefore  the  means 
are  different. 


Manistee  County 

Property  worth — In  comparing  the  data  from  the  self-administered 
assessment  to  the  independent  measurement,  both  the  t-test  and  the 
^rank-sum  test  rejected  the  null  hypothesis,  and  concluded  that  the 
property  values  provided  by  respondents  differed  significantly  from 
the  realtor's  estimates.  The  personal  interview  data  was  found  not  to 
be  normal,  so  the  t-test  is  Invalid  in  this  case.  However,  the  non- 
parametric  test  also  indicated  a difference  between  respondents' 
and  realtor's  perception  of  the  present  property  worth. 

Bluff  height — The  distributions  of  the  differences  in  bluff 
height  values  for  both  the  assessment  and  personal  interviews  were 
not  normal,  so  the  t-tests  are  not  a good  indicator  of 
statistical  significance.  The  rank-sum  tests  for  both  comparisons 
indicated  that  the  perceived  bluff  heights  were  significantly  dif- 
ferent from  the  measured  bluff  heights. 

Bluff  to  foundation  distance — Both  t-testjs  examined  in  this 
category  are  not  suitable,  because  normal  distributions  were  not 
found.  Therefore,  the  non-parametric  evaluation  can  only  be  used. 

For  both  the  assessment  data  and  the  personal  interview  data,  com- 
parisons with  the  measured  data  Indicated  rejections  of  the  null 
hypothesis  that  the  mean  differences  were  zero,  and  therefore  that 
the  values  provided  by  the  respondents  were  not  accurate. 
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TABLE 


I 


MUSKEGON  DATA  COMPARISON 


Sample 

Mean 

Parameter 

Size 

Mean 

Difference 

Property  worth-SAA* 

22 

32123 

-2972.7 

Property  worth- IM 

22 

35095 

Property  worth-PI 

30 

33720 

-2213.1 

Property  worth-IM 

3Q 

31507 

Bluff  height-SAA 

18 

79.2 

+41.4 

Bluff  height-IM 

18 

37.8 

Bluff  height-PI 

35 

50. A 

+9.5 

Bluff  height-IM 

35 

40.9 

Bluff  to  founds tion-SAA 

16 

70.6 

-4.6 

Bluff  to  foundation- IM 

16 

75.2 

Bluff  to  foundation-PI 

25 

24.4 

-48.8 

Bluff  to  foundation-IM 

25 

73.2 

* SAA  • Self-Administered  Assessment 
PI  “ Personal  Interview 
IM  - Independent  Measurements 
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TABLE  II 


MANISTEE  DATA  COMPARISON 


Sample 

Mean 

Parameter 

Size 

Mean 

Difference 

Property  worth-SAA 

22, 

71543 

+27845 

Property  worth- IM 

22 

43700 

Property  worth-PI 

13 

33346 

+3469 

Property  worth-IM 

13 

29877 

Bluff  height-SAA 

23 

50.7 

+29.6 

Bluff  helght-IM 

23 

21.1 

Bluff  height-PI 

14 

41 

+17.4 

Bluff  height-IM 

14 

23.6 

Bluff  to  foundatlon-SAA 

23 

32.7 

-37.6 

Bluff  to  foundation- IM 

23 

70.3 

Bluff  to  foundation-PI 

13 

68.4 

+8.7 

Bluff  to  foundation- IM 

13 

59.7  • 

( 
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TABLE  111 


MUSKEGON  DATA  ANALYSIS 


Parameter 

Comparison 

Type  of 
Test 

SlRniticance 

Property  worth 

SAA/IM 

t-teat* 

.605 

Property  worth 

SM/IM 

r-rs  teat 

.115 

Property  worth 

PI/IM 

t-test 

.475 

Property  worth 

PI/IM 

r-s  teat 

.201 

Bluff  height 

SAA/IM 

t-test 

.088 

Bluff  height 

SAA/IM 

r-s  test 

.144 

Bluff  height 

PI/IM 

t-test 

.014 

Bluff  height 

PI/IM 

r-s  test 

.391 

Bluff  to  foundation 

SAA/IM 

t-test 

.782 

Bluff  to  foundation 

SAA/IM 

r-a  test 

.077 

Bluff  to  foundation 

PI/IM 

t-test 

.0001 

Bluff  to  foundation 

PI/IM 

r-s  test 

.003 

TABLE  IV 

MANISTEE  DATA  ANALYSIS 

Parameter 

Comparison 

Type  of 
Test 

Significance 

Property  worth 

SAA/IM 

t-test 

.0001 

Property  worth 

SAA/IM 

r-s  test 

.007 

Property  worth 

PI/IM 

t-test 

.338 

Property  worth 

PI/IM 

r-s  test 

.039 

Bluff  height 

SAA/IM 

t-test 

.014 

Bluff  height 

SAA/IM 

r-s  test 

.007 

Bluff  height 

PI/IM 

t-test 

.013 

Bluff  height 

PI/IM 

r-s  test 

.013 

Bluff  to  foundation 

SAA/IM 

t-test 

.035 

Bluff  to  foundation 

SAA/IM 

r-s  teat 

.012 

Bluff  to  foundation 

PI/IM 

t-test 

.102 

Bluff  to  foundation 

PI/IM 

r-s  test 

.023 

* t-test  ■ pairwise  t-test 

r-s  test  - Wllcoxon  rank-sum  test 
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